AR-AI Sketchpad

AR, AI

Unity3D, Google ARCore, MadMapper, Android device, Projector, Webcamera

March 2019 ongoing

About

AR-AI Sketchpad is an augmented reality application which using artificial intelligent to enhance participants’ pen and paper sketch.

First the sketch models were trained using Pix2Pix algorithm separately with different image sets such as cats, dogs, building facades, city maps. Participants can choose what model according to what kind of sketch they want to be augmented. Then they just naturally draw on paper with pen and use AR-AI Sketchpad on mobile devices to transfer the original sketch and view the AI generated result in an AR view. It also has the project mapping version which can support larger space and multi participants.

It combines two emerging technologies and media together. Allow users to draw naturally and intuitively in a way since they learned as kids but still have the most advanced neural network algorithm help them with sketch style, color and suggestion. It can inspire general people with this artificial intelligent touch of sketch, although when it comes into professionals’ hands, it will be come powerful design and art production tool with higher fidelity models provided.

Mobile AR-AI Sketchpad

Projection mapping version